Pilot Situation Awareness and its Implications for Single Pilot Operations: Analysis of a Human-in-the-Loop Study

AbstractIn 2012, NASA began exploring the feasibility of single pilot/reduced crew operations in the context of scheduled air carrier operations. The current study examined how important it was for ground-based personnel providing support to single piloted aircraft (ground operators) to have opportunities to acquire situation awareness (SA) prior to being called on to assist an aircraft. We looked at two distinct concepts of operation, which varied in how much information was available to ground operators prior to being called on to assist a critical event (no vs. some Situation Preview). Thirty-five commercial pilots participated in the current study. Results suggested that a ground operators’ lack of initial SA when called on for dedicated assistance is not an issue, at least when the ground operator station displays environmental and systems data which are important to gaining overall SA of the specified aircraft. With appropriate displays, ground operators were able to provide immediate assistance, even if they had minimal SA prior to getting a request

Toward Online Measurement of Decision State

In traditional perceptual decision-making experiments, two pieces of data are collected on each trial: response time and accuracy. But how confident were participants and how did their decision state evolve over time? We asked participants to provide a continuous readout of their decision state by moving a cursor along a sliding scale between a 100% certain left response and a 100% certain right response. Subjects did not terminate the trials; rather, trials were timed out at random and subjects were scored based on the cursor position at that time. Higher rewards for correct responses and higher penalties for errors were associated with extreme responses so that the response with the highest expected value was that which accurately reflected the participant's odds of being correct. This procedure encourages participants to expose the time-course of their evolving decision state. Evidence on how well they can do this will be presented

Elevating Baseline Activation Does Not Facilitate Reading of Unattended Words

Previous studies have disagreed the extent to which people extract meaning from words presented outside the focus of spatial attention. The present study, examined a possible explanation for such discrepancies, inspired by attenuation theory: unattended words can be read more automatically when they have a high baseline level of activation (e.g., due to frequent repetition or due to being expected in a given context). We presented a brief prime word in lowercase, followed by a target word in uppercase. Participants indicated whether the target word belonged to a particular category (e.g., "sport"). When we drew attention to the prime word using a visual cue, the prime produced substantial priming effects on target responses (i.e., faster responses when the prime and target words were identical or from the same category than when they belonged to different categories). When prime words were not attended, however, they produced no priming effects. This finding replicated even when there were only 4 words, each repeated 160 times during the experiment. Even with a very high baseline level of activation, it appears that very little word processing is possible without spatial attention

Beyond Point Design: General Pattern to Specific Implementations

Elsewhere we have discussed a number of problems typical of highly automated systems and proposed tenets for addressing these problems based on Human-Autonomy Teaming (HAT)[1]. We have examined these principles in the context of aviation [2,3]. Here we discuss the generality of these tenets by examining how they might be applied to photography and automotive navigation. While these domains are very different, we find application of our HAT tenets provides a number of opportunities for improving interaction between human operators and automation. We then illustrate how the generalities found across aviation, photography and navigation can be captured in a design pattern

Task Allocation for Single Pilot Operations: A Role for the Ground

Researchers at NASA Ames Research Center and NASA Langley Research Center are jointly investigating issues associated with potential configurations for an environment in which a single pilot, or reduced crew, might operate. The research summarized in this document represents several of the efforts being put forth at NASA Ames Research Center. Specifically, researchers at NASA Ames Research Center coordinated and hosted a technical interchange meeting in order to gain insight from members of the aviation community. A description of this meeting and the findings are presented first. Thereafter, plans for ensuing research are presented

Contingency Management with Human Autonomy Teaming

Automation is playing an increasingly important role in many operations. It is often cheaper faster and more precise than human operators. However, automation is not perfect. There are many situations in which a human operator must step in. We refer to these instances as contingencies and the act of stepping in contingency management. Here we propose coupling Human Autonomy Teaming (HAT) with contingency management. We describe two aspects to HAT, bi-directional communication, and working agreements (or plays). Bi-directional communication like Crew Resource Management in traditional aviation, allows all parties to contribute to a decision. Working agreements specify roles and responsibilities. Importantly working agreements allow for the possibility of roles and responsibilities changing depending on environmental factors (e.g., situations the automation was not designed for, workload, risk, or trust). This allows for the automation to "automatically" become more autonomous as it becomes more trusted and/or it is updated to deal with a more complete set of possible situations. We present a concrete example using a prototype contingency management station one might find in a future airline operations center. Automation proposes reroutes for aircraft that encounter bad weather or are forced to divert for environmental or systems reasons. If specific conditions are met, these recommendations may be autonomously datalinked to the affected aircraft

Toward Single Pilot Operations: The Impact of the Loss of Non-Verbal Communication on the Flight Deck

Since the 1950s, the crew required to fly transport category aircraft has been reduced from five to two. NASA is currently exploring the feasibility of a further reduction to one pilot. In this study we examine the effects of separating the pilots on crew interaction. The results are consistent with earlier research on decision-making between remote groups. Pilots strongly prefer face-to-face interactions; however, we could find no impact of separation on their ultimate decisions. There were a number of areas in which separation negatively affected communications. We discuss possible mitigations for these areas

Application of Human-Autonomy Teaming (HAT) Patterns to Reduce Crew Operations (RCO)

Unmanned aerial systems, advanced cockpits, and air traffic management are all seeing dramatic increases in automation. However, while automation may take on some tasks previously performed by humans, humans will still be required to remain in the system for the foreseeable future. The collaboration between humans and these increasingly autonomous systems will begin to resemble cooperation between teammates, rather than simple task allocation. It is critical to understand this human-autonomy teaming (HAT) to optimize these systems in the future. One methodology to understand HAT is by identifying recurring patterns of HAT that have similar characteristics and solutions. This paper applies a methodology for identifying HAT patterns to an advanced cockpit project

Human Automation Teaming: Lessons Learned and Future Directions

Full autonomy seems to be the goal for system developers in almost every area of the economy. However, as we move from automated systems to autonomous systems, designers have needed to insert humans to oversee automation that has traditionally been brittle or incomplete. This creates its own problems as the operator is usually out of the loop when the automation hands over problems that it cannot handle. To better handle these situations, it has been proposed that we develop human automation teams that have shared goals and objectives to support task performance. This paper will describe an initial model of Human Automation Teaming (HAT) which has three elements: transparency, bi-directional communications, and human-directed execution. Transparency in our model is a method for giving insight into the reasoning behind automated recommendations and actions, bi-directional communication allows the operator to communicate directly with the automation, and finally the automation defers execution to the human. The model was implemented through a number of features on an electronic flight bag (EFB) which are described in the paper. The EFB was installed in a mid-fidelity flight simulator and used by 12 airline pilots to support diversion decisions during off-nominal flight scenarios. Pilots reported that working with the HAT automation made diversion decisions easier and reduced their workload. They also reported that the information provided about diversion airports was similar to what they would receive from ground dispatch, thus making coordination with dispatch easier and less time consuming. These HAT features engender more trust in the automation when appropriate, and less when not, allowing improved supervision of automated functions by flight crews

A Human-Autonomy Teaming Approach for a Flight-Following Task

Managing aircraft is becoming more complex with increasingly sophisticated automation responsible for more flight tasks. With this increased complexity, it is becoming more difficult for operators to understand what the automation is doing and why. Human involvement with increasingly autonomous systems must adjust to allow for a more dynamic relationship involving cooperation and teamwork. As part of an ongoing project to develop a framework for human-autonomy teaming (HAT) in aviation, a part-task study was conducted to demonstrate, evaluate and refine proposed critical aspects of HAT. These features were built into an automated recommender system on a ground station available from previous studies. Participants performed a flight-following task once with the original ground station (i.e., No HAT condition) and once with the HAT features enabled (i.e., HAT condition). Behavioral and subjective measures were collected; subjective measures are presented here. Overall, participants preferred the ground station with HAT features enabled compared to the station without the HAT features. Participants reported that the HAT displays and automation were preferred for keeping up with operationally important issues. Additionally, participants reported that the HAT displays and automation provided enough situation awareness to complete the task and reduced workload relative to the No HAT baseline